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(Sj ' 1 Introduction 

> 

We start from the weighted quasilinear mean for some continuous and strictly monotonic function 
' i[> : i" — > M, defined by 

T}- ! M t p(x 1 ,x 2 , ■ ■ ■ ,x n ) = ^ j ^2pjtp(xj) 1 , (1) 

\i=i / 

where Yll=iPj = 1; Pj > 0' x j ^ I for j = 1,2, • • • , n and n E N. If we take ^0*0 = x i then 
M^(x\,X2, • • • , a?n) coincides with the weighted arithmetic mean A(x±,X2, • • • , x n ) = Y^=i Pj x j- 
If we also take ip(x) = log(x), then M^,(xi, X2, • • • , #n) coincides with the weighted geometric 
mean G(x 1 ,x 2 , ■■■ ,x n ) = U] =1 x^ 3 . 

If ip(x) = x an d x j = in g ^tj then M^(x\,X2, • • • , x„) is equal to Tsallis entropy [TJ: 

n n j 

Hq(pi,P2,--- ,Pn) = -^2p q j^qPj = ^2Pj ln q— , (? > °> 9 7^ 1) ( 2 ) 

j = l " j = l ^ 

where {pi,£>2, • • • ,Pn} is a probability distribution with pj > for all j = 1, 2, • • • , n and the 
q— logarithmic function for x > is defined by ln g (x) = x which uniformly converges to 

the usual logarithmic function log(x) in the limit q — > 1. Therefore Tsallis entropy conveges to 
Shannon entropy in the limit q — )■ 1: 

n 

limFq(pi,p 2 ,-- - ,Pn) = H 1 (p 1 ,p 2 , - ■ ■ , Pn) = Pj logPj . (3) 
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Thus we find that the Tsallis entropy is one of the generalizations of Shannon entropy. It is 
known that the Renyi entropy [2] is also a generalization of Shannon entropy. Here, we review 
the quasilinear entropy [3] as another generalization of Shannon entropy. For a continuous and 
strictly monotonic function (j) on (0, 1], the quasilinear entropy is given by 

r^i,p 2 ,--- , Pn ) = -logr 1 rtprfiPj^J ■ (4) 

If we take 4>(x) = log (x) in (j4]), then we have I log (pi,p2, ■ ■ ■ ,p n ) = H\(p\,p2, ■ ■ ■ ,p n )- We may 
redefine quasilinear entropy by 



lf(Pl,P2,--- ,Pn)=^Ogtp 1 f^Pj^ 



(5) 



for a continuous and strictly monotonic function ifi on (0, oo). If we take i/j(x) = log (x) in 
([5]), we have I° g (pi,P2, ' ' ' -,Pn) = H%(pi,p2, ■ ■ ■ ,p n )- The case ip(x) = x l ~ q is also useful in 
practice, since we recapture Renyi entropy, namely If 9 {pi,P2, • • • ,Pn) = Rq(pi,P2i m ■■ ,f>n) 
where Renyi entropy |2j is defined by 



1 / n \ 

Rq(Pl,P2,-'- ,Pn) = T3^ l0g ( Yl P j I ' ( 6 ) 

Definition 1.1 For a continuous and strictly monotonic function ip on (0, oo)and two probabil- 
ity distributions {pi,P2, • • • ,Pn} a^d {^l, ?™2, • • ■ , r n } wrai/i pj > 0, > /or a// j = 1, 2, • • • , n, 
the quasilinear relative entropy is defined by 

Df{pi,P2, ■ ■ ■ ,p n \\n,r 2 , ■■■ ,r n ) = - logtp' 1 ^J^Pjip {^j^j ■ ( 7 ) 
The quasilinear relative entropy coincides to Shannon relative entropy if ip(x) = log (x) , i.e. 

n 

D l ° g (pi,P2,- ■ ■ ,Pn\\ri,r 2 ,'" > r n) = -^Pjlog^- = D 1 (p 1 ,p 2 ,--- ,p n \\n,r2,~' ,r n )- 

3=1 Pj 

We denote by R q (pi,p2, • • • ,Pn\\ri, T2, • • • ,r n ) the Renyi relative entropy [2] defined by 

1 ( n \ 

Rq(jPliP2i " " " iPn\\ r Xi r 2i " " " ifn) — ~ 7 log [^P^r] q I ■ (8) 



q 

This is another particular case of quasilinear relative entropy, namely for tp(x) = x l ~ q we have 

1 

(n / r . \ l-A 1-9 1 / n 

= Rq{Pi,P2,--- ,Pn\\ri,r 2 ,- ■ ■ ,r n ). 

We denote by 

n n 

D q (pi,P2,--- ,Pn\\n,r2,--- ,r n ) = ^Pji^qPj ~ ln q r j) = ~^2Pj ln q— ( 9 ) 

3=1 3=1 Pj 
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the Tsallis relative entropy. Tsallis relative entropy conveges to the usual relative entropy 
(divergence, K-L information) in the limit q — )■ 1: 

]haDg(p 1 ,p 2 , ■ ■ ■ ,p n \\ri,r 2 , ■ ■ ■ ,r n ) = D 1 (p 1 ,p 2 ,--- ,p n \\n,r 2 , ■ ■ ■ ,r n ) 

n 

= ^Pj( l °SPj - logry). (10) 
i=i 

See [H El [U O [101 HH [12l [13l HI] and references therein for recent advances and applications 
on the Tsallis entropy. We easily find that the Tsallis relative entropy is a special case of Csiszar 
/-divergence [15], [T6J, [TT] defined for a convex function / on (0, oo) with /(l) = by 



D f (pi,P2,--- ,Pn\\n,r 2 ,- ■ ■ ,r n ) = ^Z r if [ — ) 

3=1 W 
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r- 

since fix) = — xln q (1/x) is convex on (0, oo), vanishes at x = 1 and 

D -x\n q (l/x)(Pl,P2,--- ,Pn\\n,r2,--- > r n) = D q (pi,p 2 ,-' ,Pn\ Vl, r 2 , ' ' ' ,r n ). 

Furthermore, we define the dual function with respect to a convex function / by 

/•(*)= tf(~) (12) 

for t > 0. Then the function f*(t) is also convex on (0, oo). In addition, we define the f- 
divergence for incomplete probability distributions {a±,a 2 ,--- ,a n } and {bi,b 2 --- ,b n } where 
a, > and bi > 0, in the following way: 

n / b\ 

D f *(a u a 2 , ■ ■ ■ ,a n \\bi,b 2 , ■■■ ,b n ) = ^ajf* ( — ] . (13) 

3=1 KajJ 

On the other hand, the studies on refinements for Young's inequality have given a great 
progress in the papers [HI H3 [20l EH [22l [231 EH [251 E3 EH [281 [29]. In the present paper, we 
give some inequalities on the Tsallis entropies applying two type inequalities obtained in [23"ll2"6]. 
In addition, we give the generalized Han's inequality for the Tsallis entropy in the final section. 

2 Tsallis quasilinear entropy and Tsallis quasilinear relative en- 
tropy 

As an analogy with ([5]), we may define the following entropy. 

Definition 2.1 For a continuous and strictly monotonic function ip on (0, oo) and q > with 
q ^ 1, Tsallis quasilinear entropy (q- quasilinear entropy) is defined by 



where {pi,p 2 , ■ ■ ■ ,Pn} is a probability distribution with pj > for all j = 1, 2, • • • , n. 
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We notice that if ip does not depend on q then lim g _>i lf{pi,P2, • • • iPn) = lf{pi,P2, • • • iPn)- 
For x > and g > with g 7^ 1, we define the g-exponential function as the inverse function 
of the g-logarithmic function by exp g (x) = {1 + (1 — q)x} 1 ^ 1 ~ q \ if 1 + (1 — q)x > 0, otherwise 

it is undefined. If we take ip(x) = \n q (x) then we have I q nq (pi,p2, ■ ■ ■ ,p n ) = Hq(pi,P2, ■ ■ ■ ,p n )- 
Furthermore, we have 

i i 

1-9 / n \ 1-9 



Iq 9 {Pl,P2r-- ,Pn) = hlq ^PjPj M = ln g J2 P 



i=i / \i=i 



(E^)'-p-i E?=i (pj-Pj) , 

Hq(Pl,P2,--- ,Pr> 



1-q 1-q 
Proposition 2.2 Tsallis quasilinear entropy is nonnegative: 

lf(j>l,P2,--- ,Pn)>0. 

Proof: We assume that tp is an increasing function. Then we have tp — V'OO from 

^7 > 1 for pj > for all j = 1,2, ••• , n. Thus we have Yl^iPjtP — ^(1) which implies 

ip^ 1 \ YJj = iPji) (^~)) — 1) since V ;_1 is a l so increasing. For the case that ip is a decreasing 
function, we can prove it similarly. 

■ 

We note here that the g-exponential function gives us the following connection between Renyi 
entropy and Tsallis entropy [30J: 



expR q (pi,p 2 ,--- ,Pn) = exp q H q (p 1 ,p 2 ,--- ,Pn)- (15) 
We should note here exp g H q (pi,p2, • • • ,p n ) is always defined, since we have 

n 

1 + (1 - q)H q (p 1: p 2 , ■■■ ,p n ) = Y,Pj > °- 

i=i 

From f)15[) . we have the following proposition. 

Proposition 2.3 Let A = {Ai : i = 1, 2, • • • , A;} 6e a partition of {1, 2, • • • , n} and put pf 1 = 

J2jeAiPj- Then we have 

E^EM'. (o<g<i), as) 

i=i j=i 
i=i j=i 

Proof: We use the generalized Shannon additivity (which is often called g-additivity) for 
Tsallis entropy (see [8] for example): 

H q (x n ,--- ,x nmn ) =H q (xx,--- ,x n ) + y^xfHq (—,••• . (18) 

f-f V x i x i ) 
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where Xij > 0, Xi = Y^?=i x ij> = 1> ' ' ' , J = 1, • • • , Wj). Thus we have 

H q (pi,P2,-" ,Pn) > H q [pf,p£,--- ,p£) , (19) 

since the second term of the right hand side in (fTHj) is nonnegative, because of the nonnegativity 
of Tsallis entropy. Thus we have 

expi? 9 (pi,p 2 , ■■• ,Pn) = exPqH q (pi,P2, ••• ,Pn) 

> exp q H q (pf,p£,--- ,p£) 
= expR q (pf,P2,--- ,Pk) > 

since exp ? is a monotone increasing function. Hence the inequality 

Rq(Pl,P2,--- ,Pn) > Rq {PliPfr-- ,Pk) > ( 2 0) 

holds, which proves the present proposition. 



Definition 2.4 For a continuous and strictly monotonic function if) on (0, oo) and two probabil- 
ity distributions {pi,p 2 , • • • -,Pn} and {r\, T2, • • • , r n } with pj > 0, rj > for all j = 1, 2, • • • , n, 
the Tsallis quasilinear relative entropy is defined by 



(21) 



For iJj(x) = \n q (x) the Tsallis quasilinear relative entropy becomes Tsallis relative entropy, 
that is 



Dq n "{pi,P2, ■ ■ ■ ,Pn\\n,r2,--- ,r n ) = ~^2Pj ln q^: = D g{Pi,P2,--- ,Pn\\n, r 2 , • • • ,r n ), 
and for tp(x) = x 1_<? , we have 



— i 

l-q\ 1-9 n \ 1 ~9 



En o 1- 



En I q l—o 



1 - q l-q 
= Dq(pi,p 2 ,--- ,Pn\\ri,r 2 ,--- ,r n ). (22) 

We give a sufficient condition on nonnegativity of Tsallis quasilinear relative entropy. 

Proposition 2.5 If tp is a concave increasing function or a convex decreasing function, then 
we have nonnegativity of Tsallis quasilinear relative entropy: 

D q h {pi,P2,- ■ ■ ,Pn\\n,r 2 ,--- ,r n ) > 0. 
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Proof: We firstly assume that ip is a concave increasing function. The concavity of ip shows 
that we have ip fe" =1 PjJjJ > YTj=\Vj^ which is equivalent to ip(l) > Y^j=xPji } (^~) • 
From the assumption, ip~ l is also increasing so that we have 1 > ip" 1 (^j^Pjip • There- 

fore we have — ln q ip~ 1 (^j = \Pji> — Oj smce hiqX is increasing and ln ? (l) = 0. For the 

case that ip is a convex decreasing function, we can prove similarly the nonnegativity of Tsallis 
quasilinear relative entropy. 

■ 

Remark 2.6 The following two functions satisfy the sufficient condition in the above proposi- 
tion. 

(i) ip(x) = ln q x for q > 0,q ^ 1. 

(ii) ip(x) = x L ~ q for q > 0,q ^ 1. 

It is notable that the following identity holds 

expR q (pi,p 2 , ■ ■ ■ ,p n \\ri,r 2 ,-'- , r n) = exp 2 _ ? D g (pi,p 2 , ■ ■ ■ ,p n \\n,r 2 , ■ ■ ■ ,r n )- (23) 
We should note here exp 2 _ (J D q (px,p 2 , ■ ■ ■ ,p n ||ri, r 2 , • • • , r n ) is always defined, since we have 

n 

l + (q- l)D q (p u p 2 ,-- ■ ,p n \\n,r 2 , ■■■ ,r n ) = ^P q f)~ q > 0. 

i=i 

We also find that (|23|) implies the monotonicity of Renyi relative entropy. 

Proposition 2.7 Under the same assumptions with Proposition \2.3\ and r^ = ^2j£j\_i r i > 
have 

Rq{Pi,P2,-'- ,Pn\\n,r 2 ,--- ,r n ) > R q (pf^,--- , Pk\\ r i ^ r 2 r ■ ■ ,r£) . (24) 

Proof: We recall that Tsallis relative entropy is a special case of /-divergence so that it has 
same properties with /-divergence. Since exp2„,j is a monotone increasing function for < q < 2 
and /-divergence has a monotonicity [15} [T7] , we have 

expR q (p 1 ,p 2 , ■ ■ ■ ,p n \\n,r 2 ,--- ,r n ) = exp 2 _ q D q (pi,p 2 , ■ ■ ■ ,p n \\n,r 2 , ■ ■ ■ ,r n ) 

> ex.p 2 _ q D q (pf,p 2 A ,--- ,p£\\rf,rf,--- ,r£) 

n ( A A Aw A A A\ 

= expi2 9 (pi,p 2 ,--- ,Pk\\ r l , r 2 , r k) , 

which proves the statement. 

■ 

3 Inequalities for Tsallis quasilinear entropy and /-divergence 

In this section, we give inequalities for Tsallis quasilinear entropy and /-divergence. For this 
purpose, we review the results obtained in [23J as one of generalizations of refined Young's 
inequality. 
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Proposition 3.1 ( 123$ ) For two probability vectors p = {pi . p?. • • • ,p n } and r = {n, • • • ,r n } 
suc/i i/iai pj > 0, rj > 0, Yll=i Pj = Y^j=i r i = ^ anc ^ x = X2 ' " ' > x ™} sucft i/iai x» > ; we 
have 



mm i ^ ir(/,x,p) < T(/,x,r) < max i ^T(/,x,p), (25) 
l<i<n ypi ) l<i<n 



where 



T(/,x,p) = Jjpj/fo) - / U- 1 r &i^i)J J > ( 26 ) 

/or continuous increasing function tp : I I and a function f : I — > J such that 

f^-\{l - XMa) + A^(6))) < (1 - A)/(a) + A/(6) (27) 
for any a,b £ I and any A 6 [0, 1] . 

We have the following inequalities on Tsallis quasilinear entropy and Tsallis entropy. 

Theorem 3.2 For q > 0, a continuous and strictly monotonic function if] on (0, oo) and a 
probability distribution {rx,T2, • • • , r n } with rj > for all j = 1, 2, • • • , re, we have 

< Iq{n,r 2 ,--- ,r n ) ~ H q (r 1 ,r 2 ,--- ,r n ) 



< n max 

Ki<n 



Proof: If we take the uniform distribution p = {i---^} = uin Proposition 13.11 then we 
have 

re min {n} T n (f, x, u) < T„(/,x, r) < re max {rj T„,(/, x, u), (28) 

l<j<71 l<j<71 

(which coincides with Theorem 3.3 in [23J). In the inequalities (|28p . we put f(x) = — ln g (x) and 



j 



i for any j = 1, 2, • • • , re, then we obtain the statement. 



Corollary 3.3 For q > and a probability distribution {ri,r%, — - ,r n } with rj > for all 
j = 1, 2, • • ■ , re, we /iawe 

< re min fa} ( In, ( ± £ 1 ] - I g In, 1 J < In, re - H fl (n, r 2 , • • • , r n ) 



< re max 

Ki< 



i^^)-^'"^}' (29) 



Proof: Put V'(x) = x in Theorem [X 



Remark 3.4 Corollary I 3. 31 improves the well-known inequalities < Hq(r±,r2, ■ ■ ■ ,r n ) < ln g n. 
//we ta&e f/ie limit q — > 1, the inequalities (fl5U recover Proposition 1 in fTPj /. 
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We also have the following inequalities. 

Theorem 3.5 For two probability distributions p = {p\,P2,-'~ >Pn} &nd r = {r%,r2,--- ,r n }, 

3 



p 2 

and an incomplete probability distribution t = {ti,t2, ■ ■ ■ ,t n } with tj = we have 



< 



,§?„{§} ( D Ht||P)-/(g t3 )) 



< »/(pl|r) i \ -\\ />, (t||p) - / | >_/, | | . CIO) 

Proof: Put Xj = — in Proposition 13.11 with tp(x) = x. Since we have the relation 



.i 

we have the statement. 



n / \ n / \ n 



* (Ei 



Corollary 3.6 ([19]) Under the same assumption as in Theorem \3.5\ we have 



< min 

Ki<n 



< D 1 (r 

Proof: If we take f(x) = — log (x) in Theorem I3.5| then we have 

n n 

D f(p\\ r ) = ~^2 r j lo S— = E r -?' log ~ = Di(r||p). 

i=i 3=1 Pj 

Since f*(x) = xlog (x) and tj = we also have 

/ n \ n / n \ n 

Df*(t\\ P ) -/ j> = E^^ff E*i = E^S + lo g ( E*i 



^•log^+iog i j> I =l oglE^I -^(pii r )- 



4 Inequalities for Tsallis entropy 

We firstly give Lagrange's identity [32], to establish an alternative generalization of refined 
Young's inequality. 
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Lemma 4.1 (Lagrange's identity) For two vectors {ai,a2,--- i^n} and {61,62,- •• ,b n }, we 
have 



\k=l / \k=l 



\k=l 



' n \ / \ ( \ 1 

Y a k ) ( Y b k ) - ( Y akhk = 2 S Z ( a A- - a ^ 

/ 1=1 j=i 

= ^ ( a i b j ~ a j b iY 
l<i<7<n 



(31) 



Theorem 4.2 Let f : I — > R be a twice differentiable function such that there exist real constants 
m and M so that < m < f"(x) < M for any x £ I. Then we have 



m 



l<j<j'<n 



3=1 

M 



< ir y P ip j fa ~ x *y 



(32) 



l<i<j'<n 



where pj > with Y^j=xPj = 1 an d x j ^ I f or a ^ 3 = 1 7 2, • 



, n. 



Proof: We consider the function g : / — > M defined by g(x) = f(x) — yr. Since we have 
g"(x) = f"(x) — m > 0, g is a convex function. Applying Jensen's inequality, we thus have 



^pjgixj) > g Y^r 



(33) 



3=1 



where pj > with Y^=i Pj = 1 an< ^ x j ^ I f° r an .7 = 1> 2, • • • , n. From the inequality (|33p . we 
have 



77i 

y 



YpA YPr 



Y p i x i 



l<i<j<n 
l<i<j<n 



In the above calculations, we used Lemma 14.11 Thus we proved the first part of the inequalities. 

Similarly, one can prove the second part of the inequalities, putting the function h : / 

M 
2 



defined by h(x) = ^x 2 — fix). We omit the details 



Lemma 4.3 For {pi,P2,-" ,Pn} with pj > and YT 3 =\Pj = lj an d {x\,X2,--- ,x n } with 
xj > 0, we have 

n / n \ 2 

Y p*Pj ( x j - x *) 2 = Y p j [ x i ~Y piXi ) • ( 34 ) 
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Proof: We denote 



^2 Pi 



X — / p{X{. 
i=l 

The left side term becomes 



^ n n n n 

Y PiPj (xj-Xi) 2 = g E E Kp i ( x i ~ Xi ) 2 = 2 2^ ^ Wj ^i + Xl? ~ 2x o x i) 

i<j<n i=l j=l i=l j=l 

n n * n n n n 

= 2 S Y PiPitf + 2 £ S PiPjX * ~ Z Z W^ 3 * 

i=l j=l i=l j = l i=l j=l 

j n n ^ n n n n 

9 S ft Z + 9 Z PiX i Y p i ~ Y PiXi Y Pi x i 



i=l j=l i=l j=l i=l j=l 



2 -2 
X . 



= YPi x ) 

3=1 

Similarly, a straightforward computation yields 

n / n \ ^ n n 

y^Pj ( - y^pjXj j = (x| - 2xjx + x 2 ) = Ypjtf ~ 2x2 + ^ 2 

3=1 V i=l / i=l j=l 



Ypj x . 

3=1 



2 -2 
3~ X ■ 



This concludes the proof. 

Corollary 4.4 Under the assumptions of Theorem \4-S\ we have 

n / n \ ^ n 

y 5^Pj ( x i ~ Y PiXi ) - Y p if( x ^ - f [ Y p i x i 



3=1 V i=l / 3=1 \3=1 



M " / " \ 2 

< — | xj - 2^^^ J • ( 35 ) 



j=l \ i=l / 

Remark 4.5 Corollary \4-4\ gives a similar form with Cartwright- Field's inequality J22F-' 
1 n / n \ ^ n n 

o-^7 Z) W ( x i " P iXi ^ Y Po x 3 - n x ? 

3=1 \ i=l J 3=1 j=l 

^ ^Ypj[ x j-Yp iXi ) 

j=l \ i=l J 



(36) 



where pj > for all j = 1,2, ••■ ,n and Y^j=iPj = 1, m' = min{xi, X2, • • • ,x n } > and 
M' = max{xi, X2, • • • , x n }. 

We also have the following inequalities for Tsallis entropy. 
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Theorem 4.6 For two probability distributions {pi,P2> • • • ,Pn} and {ri,V2, ■ ■ ■ , r n } withpj > 0, 
rj > and Y^=iPj = Sj=i r j = 1> ^ ^a?;e 



— E ^(--- 

l<i<i<n v 3 1 



n ^ n ^ 

P? 



I P7 1 1 Mq sr^ ( 1 1 \ 2 m <? /'I 1 X ' 

,j=l 3 I ±<i<j<n P%J l<i<j<n 



(37) 

where m q and M q are positive numbers depending on the parameter q > and satisfying m q < 
qrj 9-1 < M q and m q < qpj 9 " 1 < M q for all j = 1, 2, • • • , n. 

Proof: Applying Theorem 14. 2 1 for the convex function — ln ? (x) and Xj = ^7, we have 



i<i<j<n v J 4 7 j=i 3 y=i J / 

M q / 1 1 \ 2 

< -j 2 E «Pj -"- > (38) 

l<«<j<™ J 

since the second derivative of — ln g (x) is qx~ q ~ 1 . Putting rj = pj for all j = 1, 2, • • • , n in the 
inequalities (|38l) . it follows 

2 n 



2 E * -E^^+s 



l<i<j'<n 

From the inequalities f)38[) and (|39p . we have the statement. 



Mq / 1 1 \ 2 

< E w • 39 

2 Vpj Pi/ 



Remark 4.7 The first part of the inequalities $39\) gives another improvement of the well-known 
inequalities < H q (ri,r2, ■ ■ ■ , r n ) < ln q n. 

Corollary 4.8 For two probability distributions {pi,P2, ■ ■ ■ ,Pn} o,nd {rx,r%, ■ ■ ■ ,r n } with pj > 
0, rj > and YTj=\Pj = Sj=i r j = 1; we have 

( n \ m ( 1 1 \ ^ ikf / 1 1 ^ ^ 

j=l 3 / l<i<j<ra V 3 7 l<i<3<n 

n \ n 1 

< E^ lo g--E^ lo s- 

^ lQ g LL - - lo § n + — w ( - - - j --2 1^ Pip i 

\j=l 3 J l<i<j<n 1 l<i<j<n 

(40) 
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where mi and Mi are positive numbers satisfying mi < r- < Mi and mi < p- < Mi for all 



.u I <m i>ihsiiii>i 1 1 a i ii in. i s st u i sj i/i a i/ 1 1 1 [ ^ /• • > ' ' ••• *' •• 

J = 1,2,--- ,n. 

Proof: Take the limit q — > 1 in Theorem 14.6 



Remark 4.9 The second part of the inequalities f^0| ) gives the reverse inequality for the so- 
called information inequality 1331 Theorem 2.6.3]: 



n n | 

o < y^po lo s - - Y p j log - ( 41 ) 

in _ Pi 



j ' 1 .i i Pj 

which is equivalent to the non-negativity of the relative entropy: 

Di(pi,P2, ■ ■ ■ ,Pn\\n,r 2 , ■■■ ,r n ) > 0. 
Using the inequality (jSJ, we derive the following result. 



Proposition 4.10 For two probability distributions {pi,P2r'~ iPn} o,nd {ri,r2, ■■■ ,r n } with 
< pj < 1, < Tj < 1 and Yl]=iPj = Sj=i r j = 1j we have 



n \ n 1 

Y (1 - Pj) log — — < Y C 1 - ^) lo S T~T' 



(42) 



Proof: In the inequality (|4*T|) . we put = and = which satisfy Y^j=i \~~i 
Y^j=i Ti^i = 1- Then we have the present proposition. 



5 A generalized Han's inequality 

In order to state our result, we give the definitions of the Tsallis conditional entropy and the 
Tsallis joint entropy. 

Definition 5.1 ( \34\^ ) For the conditional probability p(xi\iij) and the joint probability p(xi,yj), 
we define the Tsallis conditional entropy and the Tsallis joint entropy by 

H q (pc\y) = -Yp(^,Vj) qi ^P^i\yj), (q>0,q^l), (43) 
hi 

and 

H q (x,y) = -Yp( x i>yj) 9ln <iP( x i>yj)> (9 > 0,9^1)- (44) 

hi 

We summarize briefly the following chain rules representing relations between Tsallis condi- 
tional entropy and Tsallis joint entropy. 

Proposition 5.2 ([34, 9]) Assume thatx,y are probability distributions. Then 

H q (x,y) = H q (x) + H q (y\x). (45) 
Proposition 15.21 implied the following propositions. 
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Proposition 5.3 ([fty) Suppose x\, X2, •• • , x n are probability distributions. Then 

n 

H g (xi,x 2 , • • • , X„) = ^ H q (Xi |xj_i, • • • ,Xi). (46) 



i=l 



Proposition 5.4 ( \34\ IE/) For q > 1, two probability distributions x and y, we have the 
following inequality: 

H q (x\y)<H q (x). (47) 
Consequently we have the following self-bounding property of Tsallis joint entropy. 

Theorem 5.5 (Generalized Han's inequality) Let xi,X2,--- , x n be probability distribu- 
tions. Then for q > 1, we have the following inequality: 

1 n 

B q (x x ,--- ,x n ) < -}H q (xx,--- ,Xj_i,x i+ i, • • • ,x„). 

n — 1 

i=i 

Proof: Since the Tsallis joint entropy has a symmetry: H q (x,y) = H q (y,x), we have 
H q (xi, ••• ,x n ) = H q (xi, ■ ■ ■ ,Xj_i,Xi + i, • • • ,x n ) + fig(xi|xi 3 • • • ,xj_i,x i+ i, • • • ,x„) 

< H q (xi,--- ,Xj_i,Xi + l, • • • ,X n ) + -ffg(Xi|xi,--- ,Xj_i), 

by the use of Proposition 15.21 and Proposition 15.41 Summing both sides on i from 1 to n, we 
have 

n n 

nH q (x lr -- ,x n ) = y H^Xt,--- ,Xi_i,Xj + i,-- - ,x n ) + } i? g (xj|xi, • • • ,Xi_i,x i+ i, • • • ,x n ) 

i=l i=l 
n 

< y^gg(xi, • • • ,Xj_i,X i+ i, • • • ,X n ) + iJ g (x!, • • • ,X n ), 



i=l 

due to Proposition 15.31 Therefore we have the present proposition. ■ 

Remark 5.6 Theorem 15.51 recovers the original Han's inequality [35, 36], if we take the limit 
as q — > 1. 
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